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Abstract 


A brief  review  is  made  of  current  problems  on  eos^puter  image 
processing  and  recognition.  Rev  and  unpublished  results  of  a 
rotation-invariant  operator  and  an  adaptive  filtering  approach 
are  then  presented.  Finally  a sequential  binary  decision  procedure 
for  reconnaissanee  image  classification  is  discussed. 
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Image  Proceislag  and  RaooyiUpiQyi 


C.  H.  Chen 

I.  Current  Problema  on  Image  Procesaing  and  Recognition 

Current  signal  processing  and  pattern  recognition  problems  with  images  majr  be 
summarised  as  follows: 

1.  Real-time  or  near  real-time  requirements. 

2.  Time-Tarying  images. 

3.  Large  data  bue  and  the  associated  data  base  managesient. 

U.  Data  storage  and  display. 

5.  Hew  processing  and  recognition  algorithms. 

6.  Parallel  veraxis  sequential  operations. 

7.  Software  and  hajrdware  development. 

8.  Picture  representation  and  languages. 

The  above  list  is»  of  coarse,  incomplete  and  all  problems  are  not  of  eqpal 
importance.  Problem  areas  are  obviously  application  dependent.  This  paper  will 
deal  with  problem  #3  stated  above  with  applications  in  the  reconnaissance  Images 
including  FUR  imagery  and  aeiral  photographs, 
n.  A Rotation-Invariant  Digital  Operator 
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The  transfor.  function  of  the  deblurring  operation  is 
tg)  • 5 - * ^2* 

vhieh  has  frequency  i^aponse 

Mg)  » 5 - 2 COBM^  - 2 COSMg  (2 

where  m^  ■ mcosS,  Mg  ■ Maine.  Thus  H(mj^,  Mg)  is  not  rotation- invariant  aa  it 
depends  on  6. 


p p 

How  if  H(m^»  Mg)  takes  the  form  a ♦ b(Mj^  + Mg),  it  will  be  rotation-invairiant . 

Taking  the  Fourier  series  approximation, 

2 

■ a^  ♦ a^^  cosM^  + ag  co82Mj^ 

2 

Mj^  * a^  ♦ a^^  COSMg  + Sg  eo82Mg 

tor  JL  ^ ^ n 

- 2 i “i*  “2  - 2 * 

**2^  " ^o  ”*■  COSMg)  + b2(co82M^  + co82Mg)  (3) 

or  in  s-transform 

H(Sj,  tg)  ■ ^>0  ♦ ®2  * *2^^  * "1^*1  * * ^2*  *2^^ 

In  spatial  dosiain  we  can  write 

b, 

g(l.J)  ■ V(i.J)  ♦ [f(i  - 1.  J)  + f(i  + 1,  J)  + f(i,  J - 1)  + f(i,  J + 1)1 

♦ [f(i  - 2,  J)  ♦ f(l  ♦ 2,  J)  + f(i,  J - 2)  ♦ f(i,  J ♦ 2)1  (1») 

Thus  we  can  consider  a good  approximation  to  the  i^eal  rotation-invariant 
Laplacian  operator  as 

F^d.j)  • - I «i  tf(i  - 1,  J)  ♦ f(i  ♦ 1.  J)  ♦ f(i.  J - 1)  ♦ f(i.  3 * 1)1 

- I ag  lf(l  - 2.  j)  ♦ f{i  ♦ 2.  J)  ♦ f(l,  J - 2)  ♦ fd.  3 *.  2)1 

- 2 a^fd.J)  ^5) 

Kq.  (3)  clearly  is  a modification  of  existing  digital  Laplacian  operation  in 
that  pixels  of  distance  2 arc  also  included  in  the  coeiputation.  The  use  of  this 
new  local  operation  to  an  FUR  Imagery  with  tank  as  object  is  illustrated  in 
Fig.  1.  Here  Fig.  1(a)  is  theLgplaolMi  picture  while  Fig.  1(b)  is  the  result  of 
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applylng  the  new  operator.  The  improvement  In  the  lower  houndary  of  the  tank 
le  particularly  evident.  This  new  operator  should  in  general  be  very  useful  for 
objects  with  curved  boundary. 

Related  operators  considered  are  the  modified  gradient  (21  and  the  multi- 
derivative  operators  (31. 

111.  An  Adaptive  Pltering  Approeuih 

Without  the  object  boundaries,  a reconnaissance  image  may  be  modeled  as  a 
homogeneous  random  field.  Kalman  filtering  can  be  used  to  smooth  the  random 
field.  The  object  boundaries  cause  abrupt  change  in  gray  levels.  An  adaptive 
filtering  method  has  been  proposed  (Ul  for  detection  and  tfatimation  of  the  Jumps 
by  using  Kalman  filtering  and  generalized  likelihood  ratio  techniques.  n»e  method 
is  designed  for  systems  subject  to  possible  component  failures  and  the  tracking 
of  vehicles  capable  of  abrupt  maneuvers.  The  generalized  likelihood  ratio  serves 
as  a monitor  of  the  Junq>s  and  the  Juiiq)s  detected  are  used  to  update  the  state 
estimate  in  the  state  equation.  The  method  is  very  suitable  to  the  enhancement 
of  reconnaissance  Images  since  the  boundaries  will  not  be  blurred  by  the  Kalman 
filtering  due  to  the  adaptive  behavior  of  the  algorithm.  The  state  of  the 
dynamical  system  is  the  gray  level  of  a pixel.  If  several  pixels  are  considered 
then  the  state  is  a vector  quantity.  The  random  field  is  modeled  as  a Markov 
chain  and  the  recursive  filtering  operation  can  be  performed  efficiently.  The 
detection  by  the  generalized  likelihood  ratio,  however,  makes  use  of  several 
data  points  in  a data  window.  Thus  false  alam  possibility  can  be  minimized. 
Computer  results  are  given  in  Pigs.  2 and  3.  Figure  2(a)  shows  artlficlaladata 
with  one  positive  Jump  and  additive  noise.  The  result  of  adaptive  filtering  is 
shown  in  Pig.  2(b).  The  noise  removal  is  very  obvious  while  the  Jump  le  not 
blurred  at  all.  The  Initial  set  of  data  points  rises  rapidly  to  a constant  level, 
and  then,  after  a Jtsip,  to  another  constant  level. 


Figure  3(a)  is  the  residt  of  adaptive  filtering  on  real  aerial  photograph 
also  with  tank  as  an  object  moving  on  a road.  ^Rie  picture  clearly  shows  the 
object  from  its  background.  If  additive  Gaussian  noise  is  added  to  the  original 
picture,  we  have  Fig.  3(b).  The  roeid  now  cannot  be  distinguished  from  its 
background.  Figure  3(c)  is  the  result  of  adaptive  filtering.  Considering  the 
small  Bignal-to-noise  ratio,  the  improvement  is  significant.  The  filtering 
operation  is  performed  line  by  line.  Parsdlel  operation  may  be  used  to  speed-up 
the  processing. 

The  adaptive  filtering  method  offers  a very  effective  procedure  to  enhance 
the  image  without  blurring  the  object  boundaries.  The  additive  and  multiplicative 
noises  are  suppressed  by  the  filtering  operation.  The  technique  is  also  suitable 
for  time-varying  pictxxres  and  offers  more  flexibility  than  conventional  smoothing 
operations. 

TV.  The  Image  Recognition  Problem 

The  recognition  problem  considered  here  is  the  detection  and  location  of  the 
target  Tdiich  is  a man  made  object.  Examples  of  other  recognition  problems  not 
considered  here  are  the  aircraft  identification,  discrimination  among  different 
object,  etc.  For  human  visualization,  object/beujkground  segmentation  serves  the 
purpose  of  separating  the  object  at  a given  location  from  the  surrounding  background. 
The  Joint  use  of  gray  level,  edges,- and  texture  has  been  considered  for  segmentation 
of  FLIR  Imagery  [51.  For  the  recognition  problem  we  consider,  the  aerial  photograph 
first  partitioned  into  a number  of  small  segments.  Features  are  extracted  from 
each  segment  including  texture,  average  gradient  measure,  entropy  measure,  etc. 

[6].  As  the  feattires  are  of  different  nature,  statistical  classification  is  not 
appropriate.  A sequential  binary  decision  tree  is  used  which  starts  with  the 
best  feature  and  examines  the  decision  made  by  each  feature  sequent isJ.ly. 

Additional  features  are  used  only  when  the  decisions  are  not  consistent/  The 
classification  schesw  was  able  to  provide  correct  recognition  for  all  images  we 


had  available. 
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